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1. Introduction 

Let $ = (V'n)^Li be a semi- normalized Schauder basis for a Banach 
space X. For f E X, let (c n (/))^ =1 denote the sequence of basis co- 
efficients for /. The Thresholding Greedy Algorithm (TGA) was intro- 
duced by Temlyakov |7J for the trigonometric system and subsequently 
extended to the Banach space setting by Konyagin and Temlyakov [5]. 
See [H] and the recent monograph [10J for the history of the problem 
and for background information on greedy approximation. The algo- 
rithm is defined as follows. For / e X and n > 1, let A n (x) C N be 
the indices corresponding to a choice of n largest coefficients of / in 
absolute value, i.e., A n (/) satisfies 

(1) min{| Ci (/)|: i e A n (/)} > max{| Cl (/)|: % $ A n (/)}. 

(Note that A n (f) is uniquely defined if and only if there is strict in- 
equality in flTJ.) We call G n (f) := Y,i<=A n (f) c i{f)A an nth greedy ap- 
proximant to f and say that the TGA converges if G n (f) — > f. The 
basis \1/ is said to be quasi-greedy if there exists K < oo such that 
for all / G X and n > 1, we have ||G n (/)|| < Wojtaszczyk 
[Ti] Theorem 1] proved that \l/ is quasi-greedy if and only if the TGA 
converges for all initial vectors / 6 X. 

It was proved in [51 Remark 6.3] that the one- dimensional Haar ba- 
sis for Li[0, 1] (normalized in Li[0,l]) is not quasi-greedy, i.e., that 
the TGA does not converge for certain initial vectors /. However, it 
was proved in [1] that there is a weak thresholding greedy algorithm 
(WTGA) for the Haar basis which converges. 

A WTGA is a procedure of the following general type. Fix a weakness 
parameter t with < t < 1. For each / e X, define an increasing 
sequence (A^(/)) of sets, consisting of of n coefficient indices, such 
that 

(2) min{| Q (/)| : i G A*„(/)} > t max{|q(/)| : i $ A n (/)}. 

The WTGA is said to converge if the sequence of weak greedy approx- 
imants G l n (f) := ^ i67 v*(/) c i(/)V'i converges to /. It was proved in [6] 
that quasi-greediness of \1/ guarantees convergence for every WTGA. 

However, if \1/ is not quasi-greedy then the index sets (A^(/)) must 
be carefully chosen to ensure convergence. For the WTGA defined in 
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jl] it was proved that the algorithm converges and that the weak greedy 
approximants are uniformly bounded, i.e., that < 
where K(t) depends only on the weakness parameter. 

In [8] it was proved for the multivariate Haar system, normalized in 
L p [0, l} d , for d > 1 and 1 < p < oo, that 

\\f-G n (f)\\<C(p,d)a n (f), 

where cr n (f) denotes the error in the best n-term approximation to / in 
the L p norm using the multivariate Haar system. As remarked above, 
convergence fails for p — 1. The goal of the present paper is to extend 
the results of [I] to the multivariate Haar system for Li[0,l] d . The 
case d — 2 is especially interesting from the point of view of practical 
applications, and we refer the reader to [1] (and its references) for a 
nice exposition of the two-dimensional discrete Haar wavelet transform 
and its use in image compression. 

Some serious obstacles have to be overcome in extending the one- 
dimensional results to higher dimensions. These difficulties are for the 
most part already present in the case d = 2. On the other hand, the 
passage from d = 2 to d > 3 is relatively straightforward. 

The first obstacle in extending the one-dimensional algorithm of [I], 
which impeded progress on this problem for a considerable period, is 
that " the obvious generalization" fails to converge. Therefore, a more 
complicated algorithm is required, which depends on two parameters: 
the weakness parameter t and a second parameter s, where < t < s. 
An important feature of the algorithm, which it shares with the simpler 
one-dimensional algorithm, is that the weak greedy approximant is 
updated by applying a basic greedy step to the residual vector R^if) = 
f — G^(/). The form of this greedy step ensures that the algorithm is 
branch- greedy in the sense of [2]. Roughly speaking, this means that 
the selection of the next coefficient in the basic greedy step depends 
only on the natural (finite) data set for weak thresholding consisting 
of all pairs 

{(t, Cl (R n (f)))- |c*(i^(/)| >tnutt| Ci (ik(/)|}- 

Let us now describe the contents of the paper. In Section 2 we re- 
call the definition of the multivariate Haar system, describe the weak 
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thresholding greedy algorithm alluded to in the title of the paper, and 
state the Main Theorem. The proof of the Main Theorem, which is 
presented in Section 7, uses two key lemmas which are proved in Sec- 
tions 3-6. 

The main result of Section 3 is the norm estimate Lemma 13.41 The 
results in Section 4 are based on the combinatorics of dyadic cubes. 
The main result of this section is the first key lemma, namely the norm 
estimate Lemma 14.61 Sections 5 and 6 are independent of Section 4. 
Section 5 contains an important symmetrization result. Section 6 is 
devoted to the second key lemma. The proof of this lemma uses an 
induction argument which makes essential use of the symmetrization 
results of the previous section. 

In Section 8 we show that the algorithms diverge for the boundary 
cases s = t and s = 1. This implies, in particular, that the multivariate 
Haar system is not quasi- greedy (Corollary 18. ip . 

2. Multivariate Haar system, Definition of the 
Algorithm, and Main Theorem 

In this paper we consider greedy algorithms for the multivariate 
Haar system. Let T> n be the set of dyadic intervals of length 2~ n and let 
V d := V n x ... x V n be the collection of all <i-dimensional dyadic cubes 
of side length 2~ n . Further, let V := {J n>1 V n and V d := {J n>1 V d . 
For a < b, let 

(0) X[a,b) (1) Xjoffi ~ X[°±£, 6 ) 

where x denotes the characteristic function. 

There are 2 d — 1 different Haar functions corresponding to the dyadic 
cube I £ V d , namely, for 1 < j < 2 d — 1, 

d 
k=l 

where x = (xi, . . . , x d ) e [0, X = X x x . . . x X d and e k £ {0, 1} 
are defined from the binary representation j = Ylt=i e fc2 d-/c - The Haar 
system is the set of all functions h% together with X[o.i) d - The Haar 
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coefficients are defined by 

(3) 4\f) = ^l)Jjh?, 

where the integral is taken with respect to (d-dimensional) Lebesgue 
measure //. We write [a, b) -< [c,d) if b — a > d — c or b — a = d — c and 
a< c. Further, for X = X 1 x . . . x X d G V d , J = J x x . . . x J d G V d , 
we write X -< J if X precedes J in the lexicographic ordering, i.e., 

• X 1 -< J u or 

• X x — J\ and X 2 -< J 2 , or 



• Xi — Ji, . . . ,X d _i = Jd-i and X d -< J d . 

Finally, we write (X, %) -< (J~, j) if X -< J or X = J and % < j. 

Note that each X G T> d is the disjoint union of 2 d subcubes belonging 
to T> d +l which we shall refer to as the immediate successors of X. 

Now we are ready to define the algorithm. For any / G Li[0, l] d and 
< t < s < 1 we define the sequence {G^ s (/)} inductively. We put 
Gft* = Gft*(/) = 0, = #o*(/) = / and for each m > 1 we define 
(*m (/) an< i Rm(f) m the following way 

1) Find the first cube in the order -<, denoted A m , and then the 
smallest value of j m , with 1 < j m < 2 d — 1, such that (A m , j m ) 
satisfies 

I cfc^m-i) 1= max | c^W-i) I 

2) Define A m D A m to be the largest cube containing A m such that 
for every X G X> d with A m CIC A m there exists 1 < i < 2 d — 1 
such that 

\cf{R s ^ 1 )\>s\c^{R^_ 1 )\. 

3) Find 1 < i m < 2 d - 1 for which | c^ m \R s J_ 1 ) | is the smallest 
value to satisfy 

(4) \ ^(KU) \> - q max | (i^-i) I ■ 

4) Let 

G s m V) ■= G^_i + cf\f)hf\ R% := f - G# 
be the updated greedy approximant and residual. 
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Remark 2.1. Step 3) may be modified by replacing the selection con- 
dition (J3J) by the following condition: 

(5) \cf\R s ^ l )\>t\ciz;{R s ^ l )\. 

This defines a second weak greedy algorithm which has exactly the 
same convergence properties as the first algorithm. 

Now we can state our main result. 

Main Theorem. Let < t < s < 1. Then the weak greedy algo- 
rithms defined above converge, i.e., f = linim^oo Gf^(f) for every f G 
Li[0, l] d . Moreover, the greedy approximants are uniformly bounded, 
i.e., for all f G Li[0, l] d and for all m > 1, 

(6) l|GJi'(/)||<C7(d, ai t)||/||. 

In Section 7 we show that Gfrf does not converge when s = t or 
s — 1. From this, in particular from the case s — t — 1, it follows that 
the multivariate Haar system is not a quasi-greedy basis in Li[0, l] d . 

3. Norm Estimates by Expansion Coefficients 
For any / G Li[0, l] d , let 

(7) sp(/):={(A,i) : cf (/)^0}, 
and let 

(8) SP(f) := {A : (A,z) G sp(f) for some 1 < % < 2 d - 1}. 
Also, for any 1 eV d , let 

(9) ^/:=/-EEM 

ACX i=l 

Note that "Pi/ is constant on X and it coincides with / outside of X. 
Recall, that the Haar system has the following monotonicity property: 

\\V x f\\ > \\Vjf\\, for any X C J. 
Also, let us denote the norm of / G L\[0, l] d on the set A by ||/||a, i-e., 

imu:= / l/l- 

J A 

Now we formulate two basic lemmas. 
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Lemma 3.1. Let f E L x [0, l] d andl,J E V d and J C X. Then 

,(0/ 



\x >| cy (/) | for any 1 < i < T - 1. 
Proo/. By ©, 



< / i/i = n/b< 

□ 

Lemma 3.2. Lei / G L x [0, l] d and suppose | c^(/) |< 1 /or a// A G £> d 
and /or a// 1 < z < 2 d — 1. Then, for any dyadic cube X G £~> d ; one has 

\\Vxf\\x<l. 

Proof. Let k be defined by /i(X) := 2~ kd . Let the chain of dyadic cubes 
{Aj}^~Q be defined by the following conditions: 

i)Tc Aj, ii) fx(Aj) = 2~ jd . 

It is clear that V%f is constant on X and that for any x E X one has 

Vxf{x) = cfl(f) +Y^c^(f)h%(x). 

j=0 i=l 

Taking into account the fact that | h^.( x ) l = 2 jd , we conclude that 
\\Vx(f)\\x < 2~ kd ^1 + J2(2 d - 1) • 2^ = 1. 

□ 

Lemma 3.3. Suppose J C X and yu(j7") = ^p-, where T,jE V d . 
Then 

\\\\Vx{f)\\x-\\Vj{f)\\j\ 

\\fh\j>\\\\4 ) \-\4 ) \\ 

{\\\\Vx{f)\\x-\4 ) \\. 
For d = 2 the constant 1/4 may be improved to 1/2. 

Proof. Here we prove the lemma (with the improved constant of 1/2) 
only for the case d = 2. The case d > 3 is proved in Section 9. 

Let us prove the first statement. The first inequality in (fTUI) below 
follows from the monotonicity property of the Haar system, while the 
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second follows from the fact that Vx{f) and Vj(f) are constant on X 
and J respectively: 



(10) 



i\j>\ I f- f 
i J j 



Vx{f)- / Vj(f)\ 
x J j 



>\ WVxWh - \\Vj(f)\\ 



J 



Let us prove the second and third statements of the lemma. Let 
S := n{X). Let us denote the value of Vx(f) on the cube I by H and 
the value of Vj(f) on the cube J by H\. 

Clearly, 

(11) \\Vx(f)\\x = S \ H |, 
and, since d = 2, 

(12) \\Vj(f)\\ 



j 



4 

Note that for some choice of signs ei, e 2 , e 3 = ±1 one has 

Let cZj :— 6jC®. Then by the monotonicity property of the Haar system 
one has 



||/||z\.7 - ^1 I H5+a 1 -a 2 -a 3 \ + | H5-a 1 +a 2 -a 3 \ + | H5-a 1 -a 2 +a 3 

Combining this inequality with f llip and using the triangle inequality 
one obtains the second and third statements of the lemma with 1/4 
replaced by 1/2. □ 

Lemma 3.4. Let K C J C I with /i(J) = and fji{K) = 
Then 

,W i _ i „W) 

ll/llzvc >l ' ' 



c x \ \ c j 



for all 1 < i,j <2 d -l. 
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Proof. Using Lemma 13.31 one gets 

\\fh\j > \ ( I '^'"f^" 1 I + I \Wx{f)h- \Wj{f)\\j 



and 

1 \ -\\Vj(f)\\j 



\\fh\K >| , 

Hence 

ll/l|ivc=ll/llivr+ll/lljvc 

1 $ \ -WPx{f)h < , , WPx(f)\\x - \\Vj(f)\\j 



> 



+ 



> 



of I -WPAf)h 
4 

JO I _ I Jj) I 



□ 



Lemma 3.5. Let /C C J c I. T/ien 

| c W | - | c (i) | 
\\fh\ic >\ — — ^ — — I • 

Proof. ViX — J then the the lemma follows from Lemma [3731 Suppose 
X ^ J . Put A = X and inductively define the chain {Ak}™ =0 of dyadic 
cubes as follows: 

K C A fc+1 c A fc , /i(A fc+1 ) = 4^ (0 < fc < m). 

Note that A m = K and that J = /S. p for some < p < s. So by 
Lemma [3741 we get 

p-i 



WfW> ll/ll ao\a p+1 >|EH/Ha 



> 



> 



2 / , ii j ii t-ifc\A t 
fc=0 

JO I I J 1 ) I p- 2 I r (1) I - I r (1) I I r (1) I - I r ij) 

c x I ~ I c Aj I li^l I c A fc I I c A fc+1 I | | I %_q I I C J 

16 1 I i 6 II i 6 

fc=i 

JO I _ I JO I 



16 



□ 
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4. Collections of Dyadic Cubes and the First Key Lemma 

Definition 4.1. Let J C X. The chain C(X, ,7) is the set of dyadic 
cubes K such that J C /C C X. 

Definition 4.2. A finite set 7?. C T> is called a generalized chain if 
there exists X max G 7?. such that for any J ^TL one has 



The cube X maa . G 7£ is called the maximal cube of 1Z. If X m(M . 7^ [0, l) d 
then the smallest cube which strictly contains X max is called the father 
ofK, denoted F(K). 

The following lemma is the analogue of [H Lemma 4]. We refer the 
reader to [4] for the proof. 

Lemma 4.3. The union of two generalized chains TZ\ and 1Z 2 is a 
generalized chain if and only if either TZi fl 1Z 2 7^ or F(1Zi) G 1Z 2 
or F(K 2 ) G Tlx. Then either F{Ki U TZ 2 ) = FiJZi) or F{Hi U TZ 2 ) = 
F{U 2 ). 

Let us recall two more definitions from [4]. 

Definition 4.4. Let S be a finite subset of T>. We say that {T^i, . . . , TZk} 
is the minimal generalized chain representation (MGCR) of V if 



b) IZi is a generalized chain for all 1 < i < A;, 

c) IZi U TZj is not a generalized chain for any 1 < i < j < k. 

It is shown in [4] that any set S has a unique MGCR. 

Definition 4.5. Let S be a finite subset of T> and X G <S. We say that 
J7" G <S is a son of X with respect to S if C(X, J7") fl S = {X, J7"}. 

The set of all sons of X with respect to S will be denoted by son(X, S). 
For any V C S, put 



max ; 



b) c(x max ,j) cn. 



(13) 




and 



(14) 



son 



k+l 



(V,S): 



son(son k (V,S),S). 
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Finally, let us define the sets 

• A (S) = {leS : son{l,S) = $}, 

• Ai(5) = {leS : | son(l,S) |= 1}, 

• A 2 («S) = {leS : I son(X,S) |> 2}. 

By induction on the cardinality of S (see jU p. 56]), one has 

(15) | A 2 (<S) |<| Aq(S) I . 

Now we are ready to formulate and prove the first key lemma. 

Lemma 4.6. Let < t < s < 1, and let p,q G Li[0, l] d be given, 
with sp(p) finite and [0, l] d SP(p). Let {TZi, . . .K k } be the MGCR 
of SP (p) . Suppose 

1) sp{p) fl sp(q) = ; 

2) for any A G SP(p) there exists 1 < i < 2 d — 1 such that 
I c%(p) |> s, 

3) if A G SP(p) n SP(g) £/ien | cg } (g) |< J | cf (p) | /or some 
(A, 2) G sp(p) and for any (A, j) G sp(q), 

4) /or every 1 < / < /c t/iere exists A G 7^ and 1 < 2 < 2 d — 1 
stzc/i tfiat | c { p {ni) (q) \<s\ c { 2(p) | /or a// 1 < j < 2 d - 1. 

T/ien 

(16) lb + <zll >c(m) IM l> 

w/iere 

M = fjJ{F(7^)}j u (sp(p) n SP(g)). 

Aote t/iai [0, l) d ^ SP(p) by assumption, and so F(1Z{) exists for each 
1 < I < k. 

Proof. We will proof the lemma for d = 2 (the extension to d > 3 is 
routine but the notation is more cumbersome). We consider two cases. 

CASE 1. | Aq(jM) |> Let X G A (jM). Then either a) X G 

SP(p) or b) X = F{Ki) for some 1 < I < k. 

a) If X G SP(p) then combining Lemma [3. II and condition 2) of this 
lemma, we conclude that 



(17) 



lb + ?llz > s. 
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b) If X = F(JZi) then the maximal cube of IZi belongs to SP(p) and 
therefore satisfies condition 2) of the Lemma. By the same argument 
as in the case a) we conclude that ( JT71) holds for X. 

Note that the cubes X G A (.M) are disjoint, so 

lb + <zll > ^\M\. 

CASE 2. | A (M) |< Taking into account ([15]) and the fact that 
A (.M) is always nonempty, one has 

(18) I Ai(M) |> 5 ! ^ ! + 1 and I At |> 12. 

6 

For X G Ai(A^), let ,7 denote the unique son of X. Let us define 

(19) A^M) = {1 e A^M) : JeA^M)}. 
Note that 

\Ai(M)\ > \Ai(M)\ - \A Q (M)\ - \A 2 (M)\ 
,5\M\ 1N |A<| 



> (— ^ + 1)- 
+ 1. 



(20) v g ■ , 12 12 

2|M| 



3 

For X G Ai(Ai), whose unique son (we recall) is denoted by J, let 
K denote the unique son of J . Let us prove that either 

(21) Ib + glk/^CiM) 

or 

(22) lb + g||.7Ve>Ci(M). 

If X G SP(p) fl SP(q) then by conditions 2) and 3) of the lemma, 
we have | c^\p) |> s and | c^\q) |< - | Cj^p) | for some i and j. 
Therefore, according to Lemma I3.5[ we have 

s — t 

\\p + q\\x\j > 



16 

Using the same argument for the case when J G SP(p) fl SP(q), we 
have 

\\p + q\\j\)C > 
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It remains to consider the case when X, J £ SP(p) fl SP(q). Then we 
have 

l=F{K h ) and .7 = F(ft, 2 ), 

for some 1 < l 2 < k. Let A and i be chosen according to conditions 
2) and 4) of the Lemma for the generalized chain IZ^. Then we have 
that 

(23) | cf{p) |> s, 
and 

(24) | 4\q) \< s | cf{p) | . 

By Lemma l473l 7^; 1 and TZi 2 are disjoint, so J £ 1Zi l and hence A <2 J 
by the definition of generalized chain. In the case when A fl J = we 
get 

||p + g||z\.7 > s 

directly from (12"3"1) and Lemma 13.11 Finally, for the case J C A we 
apply (|23|) . (1241) and Lemma l3~5l to conclude that 

s(l — s) 
\\p + q\\x\j> \ 6 ■ 

So, for every I e A X (M), either (12T]) or (122"]) holds. Recall that J 
and /C depend on X. It is to easily seen that the sets X \ J as X ranges 
over Ai(A^) are disjoint. The same is true for the sets J \ JC as X 
ranges over Ai(M.). Therefore 

lb + g||> Y \\P + lh\J' 

and 

lb + ?|| > Y lb + ?ll.7Vc- 
Using (T20]) we conclude that 

lb + g||>2 Y (lb + q\\z\j + lb + i\\j\!cj > c(s,t) \ m \ . 

2eAi(A4) 

□ 
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5. Symmetrization Properties 

We will prove the results in this section only for d = 2, but the 
extension to d > 3 is routine. 

Let A = [a,a + 25) x [b, b + 25) be a dyadic square of side length 25, 
and let Aj, 1 < « < 4, be the four disjoint immediate successor squares 
of A of side length 5 . For each 1 < % < 4, let us denote by Li(f, A) 
the function which agrees with / on the sets [0, l) 2 \ A and Aj, and 
which 

'copies' / from the square Aj to the other three squares Aj, j ^ i. 
More precisely, let Aj = Uj + Aj, where Uj G IR 2 . Then 

Li(f, A)(x) = f(x - uj) for 1 < j < 4 and for all x G Aj. 
Lemma 5.1. let f,g G Li[0, 1] 2 ; let SP(f + g) ^ 0, and let 

(25) B : = wk\- 

Then (for any square A) we have either 

(26) \\Li(f,A)\\ >B\\Li(f + g,A)\\, for some 1 < i < 4, 
or 

(27) ||L i (/,A)||=S||L i (/ + 5 ,A)||, /ora//l<z<4. 

Proof. Let us assume that the statement of the lemma is not correct. 
Then we have 

4 4 

(28) £ \Mf, A)\\<BJ2 WW + 9, A)\\. 

i=i i=i 

Note that 

4 

||Lj(/,A)|| = ||/||+4||/|| Ai -^||/|| Aj 

and 

4 

||Lj(/ + <7,A)|| = \\f + g\\ + 4\\f + g\\ Ai -J2\\f + 9\U r 

By substituting the last two inequalities into (12"8|) we conclude that, 

4||/|| <4fi||/ + p||, 
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which is contradiction. □ 

Remark 5.2. If / ^ then Lj(f, A) ^ for some 1 < j < 4. 

For f,ge Li[0, l] 2 , with / + g ^ 0, and A G £> 2 , define 
(29) 

' (Li(f, A),Li(g, A)), if (|26]) holds and ||L<(/ + p,A)|| >0 
A),Lj(g, A)), where ||L i (/ + g, A)|| > otherwise. 



L((f,g),A):- 



Lemma 5.3. Let f,g G £i[0, l] 2 and AeD 2 satisfy 

i) A ^ SP(f), A ^ SP(g), 

ii) sp(/) n sp(#) = 0, 
hi) sp(f + g) ^0. 

Further, let (/' ,#') := L((f,g), A) = Lj ((/,#), A) for some 1 < i < 
4. Then, 

1) A ^ SP(f'), A ^ SP(g'), 

2) cJ'V ) = 4 J) (/) and 4 V) = 4 J) (^) for all X with X £ A\ A, ; , 

3) for every X C A \ A, there exists J G Aj such that 4 (/') = 
c^(/) and c£'V) = c§ } (#) for all 1 < j < 4, 

4) S p(/') n sp(y') = 0, 

5) sp{f + g')^(D, 
a\ ll/'ll > 11/11 

U) \\f'+g'\\ - ll/+ffir 
Proof. From condition i) of the lemma and ([3]) it follows that 

(30) f f= f food f g= f gforalll<j,k<4. 

JAj J A k JAj J A k 

The functions /' and g' (replacing / and g) will also satisfy fl30|) . which 
gives statement 1). Clearly, j A f = j A . f and j A g = f A .g', and 
hence 

(31) //=//' and / g= f g' . 

J A J A J A J A 



If X £ A \ Aj then either X n (A \ A,j = or X = A or X D A. In 

the first case we have / = /' and g = g' on X and therefore we have 
statement 2). The second case is equivalent to statement 1). In the 
last case it is easy to check that cf (/') and 4 (#') depend only on the 
average values J A f and J A g' on A, which implies, taking f[3"Tj) into 
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account, that c£ ; (/') = c^'(f) and c^'(g') = c£>(g). Thus, the proof 
of statement 2) is complete. Statement 3) is obvious and follows from 
the definition of the operator L. 

Statement 4) follows from the condition ii) and statements 2) and 3). 
Statement 5) follows immediately from the definition of (L(f,g),A). 

Finally, let us prove statement 6). The statement is obvious if /' 
and g' are defined according to the first line of (12"§1) . Let us consider 
the case when they are defined according to the second line. We have 
two cases. 

CASE 1. Suppose (T26]) fails. Then, by Lemma [5. 1[ the set of equal- 
ities ff271) holds, which implies that we have equality in statement 6). 

CASE 2. Now suppose ([H holds, but that L<(/ + g, A) = 0. Since 
sp(Li(f)) fl sp(Li(g)) = we conclude that L^f) = Li(g) = 0. So 
inequality in fT26|) is impossible, which contradicts our assumption. □ 

6. The Second Key Lemma 

Lemma 6.1. Let f,g& Li[0, l] d , with sp(f) finite, and let {Hi, . . . , IZk} 
be the MGCR of SP(f). Suppose that 

1) SP(f) H SP(g) = 0, 

2) [0,l) d £SP(f) and[0,l) d £SP(g), 

3) F{Ki) i SP(g) for all 1 < / < k, 

4) | c£\g) |< 1 for all! eV and 1 < j < 2 d - 1, 

5) for every 1 < I < k there exist X G TZi and 1 < j < 2 d — 1 such 
that | ci\f) \>t. 

Then 

(32) < C {t). 

Proof. We may assume that < fi(F(K 2 )) < . . . < ^{F{TZ k )). 

Let 

(fi,gi) :=L(f,g,F(TZi)). 
Let Vi C F{T^-i) denote the cube from which the values of / and g 
are copied to the other immediate successor cubes of F{TZi) to define 
L(f,g). Note that SP(fi) is obtained as follows: 

1) 'Remove' all generalized chains from MGCR(f) whose maximal 
cubes are contained in F(1Zi) \ Vi, 
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2) 'Copy' all generalized chains from MGCR(f) whose maximal 
cubes are contained in V\ to the other 2 d — 1 immediate successor 
cubes of F(1Z\). 

Then fi and g\ have all properties that are listed in Lemma 15.31 In 
particular, 

11/11 < ll/ill 



\\f + g\\ ~ \\h + 9i\\ 

Inductively, for i — 2, . . . , k, let 

(fi,9i) ■= L(fi-i,9i-i,F(TZi)). 

Finally, let f ■— fk and g' := gu- It is easy to check that /' and g' have 
the following properties: 

PI) SP(f')nSP(g') = ®, 

P2) [0, l) d i SP(f') and [0, l) d $ SP(g'), 

P3) F(TZ'i) £ SP(g') for all 1 < I < k' , 

P4) | ci\g') \< 1 for all X e V and 1 < j < 2 d - 1, 

P5) for every 1 < I < k there exists I £ 1Z[ and 1 < j < 2 d — 1 

such that | c£\f) |> t, 
P6) for every 1 < I < k' the functions /' and g' are 'copied' from 

one immediate successor cube of the cube F(1Z'i) to all the other 

2 d — 1 immediate successors, 

ri) IIZ+s 11 - Wf'+g'V 
where . . . , is the MGCR of SP(f'). Let 

S ■= {Fin't) : 1 < I < k'}. 

Suppose that (/') 7^ 0. Then X belongs to some generalized chain 
TZ[ and therefore there exists J E S such that X C J . So we conclude 
that 

(33) supp(f)c\Jl. 

xes 

We say that X e 5 has order if 

son fc (X, 5) ^ and son k+1 (l, S) = 0. 
Let us prove that for any I £ S 

(34) ||/'|| z < (5r 1 + 2)||f + o'|| 2 -2t-8. 
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We use induction on the order of X. Suppose the order of X is 0. Let 
Xi,X 2 , . . . ,X 2 d be the immediate successor cubes of X. Since X G S 



then, taking into account P5), P6) and Lemma [3.11 one has 
II/' + ^'Hx, > t for all 1 < j < 2 rf . 

Hence 

(35) \\f + g'\\x>2 d t. 
It follows from Lemma 13.21 and P4) that 

(36) \\Vx{g')h<l. 

Since the order of X is equal to 0, the monotonicity of the Haar system 
and PI) give 

(37) \\r + g'\\x>\\r + V x {g')\\ x . 
Combining (1551) . (j55|) and (13"7]) gives 

( 5r i + 2 ) \\f + g'\\ x > (St- 1 + 1) II/' + g'\\ x + \\f + Vxijf) \\x 

> 2 d t(5r 1 + l) + \\f + Vx( 9 ') \\x 
>W + 2t+\\f + Vx(g')\\x 

> nrii I +2t+9, 

which gives (|3^|) for X. 

Assume now that (1M|) holds for all cubes of order < k. We will prove 
the estimate for all cubes X 6 S of order k + 1. Let Xi, . . . ,X 2 d be the 
immediate successor cubes of X and let son(X, 5) = {J7~i, ^ • • • , Ji\- 
Because of the symmetry property P6), each cube X r contains the same 
number of the J v cubes, a, say, where a > 1. Let JJi, . . . , J a be con- 
tained in X\. The cubes are disjoint and their orders are < k. 
Therefore, by the induction hypothesis, 

(39) HflU < (5r 1 + 2)||f +^-2* -8 foralH = l,2,...,a. 
LetX>:=Xx\ \\J^j\ 

a :=Vj 1 (rj 2 (...Vj a (f') ■■■)), 

and 

P--=V Jl (Vj 2 (...V Js (g') ■■■))■ 
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For a and 0, we have 

(40) a = f and (3 = g' on D, 
and by Lemma 13.21 and P4) 

(41) II^Hjj < 1 for any 1 < % < s. 

By Lemma 13.21 and the monotonicity of the Haar system, we have 

(42) h + /3\\ Xl > \\a + Vxi(P)hi > IHk-1- 
Using (j4T|) . we get 

\\0C + P\\x!\D < + ||^|k\D 

a 

= Nk\B+x;ii/3iu 

i=l 

< ||«lk\D + a. 

From (HDD and g2]), we get 

\\f' + g'\\ D = \\a + P\\ D 

= ||« + /?lk - ll a + /5||xi\d 

> - 1 - ||q;||xi\z? - a 

= \\oc\\d — a — \ 

= \\f\\ D -a-l. 
Combining this with (139]) gives 

a 

ii/'ik = ii/ik + £u/'iu 
i=i 

a 

< llf + P'lk + a + 1 + (Sr 1 + 2) E ||/' + </|U - a(2t + 8) 

8=1 

< (5t- 1 + 2)||/' + ^|| Il -2t-6. 
Using the symmetry property P6), we conclude 

ll/'llz = 2 d ||/'|k 

< (5r 1 + 2)||/' + ( 7 / || 2 -2 d (2t + 6) 

< (5r 1 + 2)||/' + ( 7 '|| I -2t-8. 

So ( 1341) holds for X. This completes the induction proof. 
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Let B := IJjes-^- We can represent the set B as the union of some 
disjoint intervals from S. Hence 

||/'|| s <(5r 1 + 2)||/' + ^|| B . 

By (E3D we have /' = on the set [0, l] d \ B, so 

||/ , ||<(5r 1 + 2)||/' + g% 
This, together with P7), completes the proof. □ 

7. Main Results 

Proof of the Main Theorem. Convergence is obvious if / — G^(f) = 0. 
So assume that Gm'^if) ^ f. Let us define 

. = G^\f) 

(43) P ' max| C W(/-G^(/)) : (A, j) E sp(f) | ' 

f-G^{f) 

q :-- 



max |cg^ -<&*>(/)) : (A,j)esp(f)\ 
It is clear that p and q satisfy all the conditions of Lemma 14.61 There- 
fore we have the estimate ffT6l). Define 



2 d -l 

(44) ?:=?"£ E^C?)^- 

xeM j=i 

Clearly, 

||g-g||<(2 d -l) 
Combining this with inequality (JTBjl yields 

( 45 ) F^ ± 4< 1 + ^4< 1 + ^4- 

lb + g|| " lb + ?ll " 

It remains to observe that functions p and q (in place of / and g, 
respectively) satisfy the conditions of Lemma 15.31 Hence 

SiT < C(t). 



\\p + q\ 

Combining this with ( I45p and ( H3|) we get 

l|G&"(/)ll „ „„. /, , 2" 



£C(( )'( 1 + C(M))- 
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which gives the uniform boundedness inequality ([6]) of the Main The- 
orem with 

(46) c(s,t,d) = C(t).{l + ^- 

To deduce convergence of the algorithm from the uniform boundedness 
of the greedy approximants, we follow the argument from [TT] for the 
Thresholding Greedy Algorithm. Let \I/ := (ip n ) c £ =Q be the enumeration 
of the multivariate Haar basis in the order determined by -<. Then \1/ 
is a Schauder basis for Li[0, l] d . For N > 0, Let Pn denote the basis 
projection onto span(^j)^ . Suppose that N = {2 d — \)Ni + 1 so that 
Pn projects onto the span of all Haar functions supported on the first 
Ni dyadic cubes in the order -<. It is easily seen from the definition of 
the algorithm that for all sufficiently large n there exists m such that 

G s /(f) = P N (f) + G s m t (f-P N (f)). 

Since \\G%(f - P N (f))\\ <C(s,t,d)\\f-P N (f)\\^OasN^oo,we 
get / = lim^oo G s /(f) as required. □ 

Corollary 7.1. For every < t < 1 there is a convergent implemen- 
tation of the weak greedy algorithm with weakness parameter t for the 
multivariate Haar basis for Li[0, l] d such that, for all f G Li[0, l] d , we 
have 

\\gm\\ < ^- t \\fi 

where C d <^2 d . 

Proof. From the proof of Lemma [4761 C(s, t) > min(s(l — s), s — 1)/24, 
and from the proof of Lemma l5.3l C(t) < 5/t+12. Settings = (l+£)/2 
and substitutuing these estimates into P6|) gives the result for G^f) := 

G'Af). □ 

Finally, let us show that Cd ^> yd. Let (r n )™ =1 be the usual 
Rademacher functions defined on [0,1]. For each finite A C N, re- 
call that the Walsh function wa '■= Y\ n eA r n- The Walsh system W : = 
{wa- A G N^ <00 ^} is a fundamental orthogonal system for Li[0, 1]. 

Theorem 7.2. Let < t < 1. The greedy approximants with respect 
to W are unbounded for every implementation of the weak thresholding 
greedy algorithm with weakness parameter t. 
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Proof. Let < u < t. For N > 1, consider 

N 

f N :=l[(l+ur n ). 

n=l 

From the independence of the Rademacher functions and the fact that 
l+ur n > 0, we get ||/at|| = 1. Also, for any implementation of the weak 
thresholding greedy algorithm with weakness parameter t, we have 

N 



' re- 

71=1 



So, by Khinchine's inequality, 



(47) \\CfN+i(fN)\\>u\\^2r n \\-l^>uVN, 



n=l 



which gives the unboundedness of the greedy approximants. □ 
Corollary 7.3. C d > Vd. 

Proof. It suffices to observe that the Haar functions X[o,i) d U {^\Qi)d) 2 ^=i 
have the same joint distribution as the initial segment of the Walsh 
system {wa- A C {1, . . . , d}}. Hence the result follows from (HTjl . □ 

8. The Boundary Cases s = 1 and s = t 

In this section we will assume that d = 2, that iV = 2k is even 
number, and that < e < 1. Let A n := [0, ^) x [0, ^). Our starting 
point is the function 

2V-1 3 

(48) /^i + EEft 



It is easy to check, that 
(49) f N 



n=0 j=l 



2 2N on Ajv, 
otherwise. 



So H/jvll = 1. 

Now let us consider the case when s — 1. Let 



n=0 i=l 
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It is clear that \\fff\\ < \\xn\\ + 3/ce. On the other hand, it is easy to 
check that 

n=0 j=l 

By using Lemma EZ] for X = A 2n +i, J = A 2n+2 , and K, = A 2n+3 , we 
get 

k 

ll^3fe+l(/Af) II — ll^3A;+l(/Af)l|A2n + l\A2n + 3 — g) 

n=0 

SO 

l|g&-i(/fr)ll > fc 

||/^|| "8(l + 3A;e)- 
Since k and e are arbitrary, we conclude that the operator G]f is not 
bounded. 

Now, let us consider the case s = t. Let 
(50) g% :=t(l + £ ^£ + /»« + (1 - e)h$ty j + 



Note that 

AT-1 
n=0 

whence by the triangle inequality ||<7^-|| < 1 + 1 + Nte. Note that 



9N = tfN-teJ2 hi Z + h[ 



(51) G 
Hence by Lemma [3.31 



& +l or w )=*(i + E( fc Si+*£))- 



|G&+iG&)ll > E I|G&+iG&)IIa.VWi > 



2 

n=0 



So 



> 



H^ll - 2(1+* + Nte)' 
Since N and e are arbitrary, we conclude that the operator G 1 ^ is not 
bounded. 

By a "gliding hump" argument (see [11] for the details) there exists 
/ G Li[0, l] d for which (G%*(/)) diverges. 

The case s = i = 1 implies the following result. 
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Corollary 8.1. The multivariate Haar system is not a quasi-greedy 
basis o/Li[0, l] d . 

9. Appendix: Proof of Lemma 13.31 

Here we prove Lemma T3.3I for d > 3. The first statement is identical 
to the case d = 2. We prove the second and third statements. Let H 
be the value of Sz(f) on X an d also /i(X) = 5. Define signs a v = ±1 in 
such a way that the value of Sj(f) is equal to H + | X^i* °p where 
a P = OpCj (/)• Let (J})^ 1 be an enumeration of the 2 d — 1 immediate 
successors of X excluding J7". For 1 < j < 2 d — 1, let = ±1 denote 
the value taken by 5a p h±^ on the cube Jj. 



Then by monotonicity 



(52) ii/iku>^Ei^+^E4 p) s.- 

j=l p=l 

For a fixed j (resp., for a fixed p) there are exactly 2 d ~ 1 of the 
coefficients {ej } that are equal to —1, and for distinct p and q the 
following orthogonality property is easily verified: 



(53) £ ef=0 

{i:4 P) =-l} 

Let us fix some p . Using fl5^|) we get 



2 d -l 

(n) 

a 7 



{j:£ (P0) = _ 1} p=1 



2 d 

which proves the second statement of the lemma. 
Finally, for distinct p and g, we have 

1 / 1 H5 — a p | | ff<5 — a q | 



2 I 2 + 

> Kz^d >| l4 p) (/)l-l4 9) (/) 



4 4 
which proves the last statement of the lemma. 
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